AN EFFICIENT DIGITAL FILTER DESIGN TOOL FOR 



APPROXIMATING AN FIR FILTER WITH A LOW-ORDER 
LINEAR-PHASE IIR FILTER 
BACKGROUND OF THE INVENTION 

5 1. Field of the Invention 

The present invention relates to a method of designing digital filters, 
and more particularly, to a method of designing low-order linear-phase IIR 
filters for approximating an FIR filter. 
2. Description of Related Art 

10 Digital filters for addressing digital signal processing have been 

applied widely in commercial electronic products, such as compact disk 
players, television sets and the like. In order to deal with real-time signals, 
the designs should be considered low computational costs to output signals 
efficiently. Also, since the distortion-free transmission of the waveforms in 

15 the passband is very important in signal processing, the filters should contain 
a linear-phase characteristic, i.e., constant group delay. 

There are two classes of digital filters. One is a finite-duration impulse 
response (FIR) filters and the other is an infinite-duration impulse response 
(IIR) filters. The main advantages of the FIR filters are exactly linear phase 

20 and guaranteed stable. However, when the specification being very rigorous, 
the resulting FIR filter is usually with higher orders, which may require more 
hardware components and lower the operational speed. Conversely, the IIR 
filters are useful for large-scale or high-speed designs but they do not have 



exactly linear phase and can not guarantee to be stable. 

One way to synthesize the IIR filters with linear phase in passband is 
to solve the rational approximation problem directly. These methods, for 
example, include Pade approximation, linear programming, nonlinear 
programming, multiple criterion optimization and eigenfilter approach. 

Another way is called the indirect approach. It will be composed of 
three steps, as shown in Fig. 1. Step 1 receives and stores the design 
specifications of a digital filter. 

These specifications are required in the frequency-domain in terms of 
the desired magnitude and phase response of the filter. Then, a linear-phase 
FIR filter, which meets design specifications, will be designed in step 2. The 
order and the coefficients of the FIR filter can be obtained using the 
conventional methods such as the frequency-sampling design technique, the 
window design technique and the optimal equiripple design technique. 
Finally, a lower-order IIR filter will be obtained using filter approximation 
techniques in step 3. It should be mentioned that the special attentions shall 
be paid on this indirect approach. The resulting IIR filter must be ensured to 
capture the linear-phase response of the original FIR filter in the passband. 

In recent years, several linear-phase IIR filter design techniques have 
been emerged for this purpose. Generally speaking, two distinct methods 
have be proposed: (1) Grammian-Based Methods: including the balanced 
truncation method and impulse response grammian method and (2) Optimal 
Approximation Methods: including the least-square approximations and the 



H 2 norm approximation. Although satisfactory results have been reported, 
computational complexity of these methods are still quite expensive. 

SUMMARY OF THE INVENTION 
The main objective of the present invention is to provide a 
5 water-preventing grommet for a pull chain switch, which efficiently keeps 
water out of the pull chain switch to avoid malfunction. 

The secondary objective of the present invention is to provide a 
water-preventing grommet for a pull chain switch, which smoothes 
operations of the pull chain switch. 
10 To achieve the objectives, the method of approximating an FIR filter 

with low-order linear-phase IIR filters by the rational Arnoldi algorithm with 
adaptive orders in accordance with the present invention contains the 
following steps: 

(a) initialize the first vector of the Krylov sequence for each expansion 
15 point; 

(b) in the jth iteration of the algorithm, choose an expansion frequency 
such, that the frequency gives the greatest difference between the 
(/+l)st-order output moment of the original FIR filter H(z) and 
that of the lower-order IIR filter H(z) ; 

20 (c) after the chosen expansion point in yth iteration being determined, 

the single-point Arnoldi method applied at the expansion point to 
generate the new orthnormal vector; 
(d) determine the new residual at each expansion point for the next 

3 



iteration; wherein the resulting orthogonal projection matrix is 
output after giving the total iteration number of the algorithm. 
BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 illustrates an indirect approach to design a low-order 
5 linear-phase IIR filter; 

Fig. 2 illustrates the design flow of the low-order linear-phase IIR 

filters; 

Fig. 3 illustrates the typical design specifications of a low-pass filter; 

Fig. 4 shows the detail flow of the rational Arnoldi method with 
10 adaptive orders; and 

Fig. 5A-7C show the bode plots of the magnitude, the error in 
magnitude, and the phase of the original FIR filters and the low-order IIR 
filters. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

15 Figure 2 shows the design flow of a low-order linear-phase IIR filter 

in the present invention in which includes the steps of receiving and storing 
the design specifications in step 1, designing an FIR filter satisfying the 
design specifications and saving the order and coefficients in step 2, 
establishing the state space matrices {A,b,c} in step 3, performing the 

20 rational Arnoldi method with adaptive orders and produce the orthogonal 
projection matrix Kin step 4, and generating the corresponding low-order 
linear-phase IIR filter, which can approximate the original FIR filter and 
satisfy the design specifications in step 5. 



Figure 3 illustrates typical design specifications of a low-pass filter in 
step 1, where the band [0,w p ] (unit 34) is called the passband and <S, (unit 
36) is the acceptable tolerance (or ripple) in the passband, the band [co s ,ji] 
(unit 38) is called the stopband and <5 2 (unit 40) is the corresponding 
tolerance (or ripple), and the band [a> p ,co s ] (unit 42) is called the transition 
band. R p is the passband ripple in dB, where R p = -201og 10 [(1-6^/(1 + 6^]. 
A s is the stopband attenuation in dB, where A s = -201og 10 [5 2 /(l+<5 1 )] . 
Notably, either {d x ,d 2 } or {R p ,A s } is required to be stored in step 1. 

Suppose that an FIR filter has been designed to satisfy the design 
specifications in step 2. Let H(z) = 2"=cA z "' be the causal FIR filter witn 
length n+l.A state-space realization of H(z) in step 3 can be described as 

x(k +l)=Ax(k) + bu(k) 

y(k) = c T x(k) + h 0 u(ky ^ 

where 
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and A<ER nx ",b&R",c(=R n . The transfer function H(z) can also be 
expressed as H(z) = c T X(z) + h 0 =c T (zI„ -A)~ l b +h 0 . Our problem 
formulation is to find a lower-order IIR filter H (z) , which satisfies the same 
specifications in step 1 as the original FIR filter H(z) and maintains a 
linear-phase response in the passband. 



The way in the invention is to find an optimal IIR filter by using 
orthogonal projection of the original FIR filter. By matching some 
characteristics of the original FIR filter, the resulting orthonormal matrix V 
can be generated in step 4. The lower-order IIR filter H(z) can be 
5 constructed using the orthonormal projection x{k) =Vx(k) . In such a situation, 
the parameters of the IIR filter can be defined by the following congruence 
transformation in step 5, 

A = V T AV, b = V T b, and c = V T c . (3) 
It can be shown that the matrix V T AV is always stable as long as (1) and 
10 matrix A is stable, (2) V T V = / . Thus, the stability of the lower-order IIR 
filter generated by Eq. (3) is guaranteed. 
Pade approximation and moment matching 

The basis theory of the method in the invention is the multi-point Pade 
approximation, or so called the multi-point moment matching, to obtain a 
15 low-order IIR filter. Expanding X{z) in power series about various 
frequencies {z x , z 2 , ■ ■ ■ , z* } , where each z f = e jWi e C and 0 == co, n , we have 

X{z) = J j X^\z i ){z-z i y , (4) 

where 

X^( Zi ) = [-( Zi I n -Ay l y( Zi I„ -AY'b, 

H^(Zi) = c T X^( Zi ) 0>0), (5) 

tf<W(* i )-c I, jr<P)(z i ) + v 

20 X U) (Zi) is called the y'th-order system moment of X(z) ; H U) (z t ) 

6 



represents the yth-order output moment of H(z) at z t . Notably, if i = 1, Eq. 
(4) is indeed the conventional Pade approximation. The objective is to find a 
g-order (q < n) IIR filter H{z) = c T {zl q - Ay l b + h Q such that 
H^\ Zi )^H^\ Zi ) for and i =1,2,-. where g-Jw^" 

5 It shall be mentioned that moment calculations can be obtained 

analytically by exploring special characteristics of matrices A and b in eq. (2). 
For each z i9 {zj n -A)~ 1 b and {z i I n - A)' 1 can be derived analytically as 
the following formulas: 
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(zJ.-A^b-b/z, l/zf - i/z;f. 
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Krylov subspace and the Arnoldi method 

Explicitly computing moments usually yields numerically 
ill-conditioned problems. We adapt recent works about the Krylov space 
method to solve these problems. Given a square matrix EC 71X71 and a 
15 vector £eC rt , the qth Krylov sequence 

K q OP, §) = span(£, W 2 £, • • , 
is a sequence of q column vectors and the corresponding column space is 
called the 4th Krylov subspace. Set W = ( Zi I n - Ay 1 and £ = -A)~ l b. It 
has been shown that the Krylov subspace K q Q¥,g) is indeed spanned by the 



system moments X U) {z t ) for ; = 0,1, •-,<?- 1 . The Arnoldi method, a kind of 
Krylov subspace methods, is employed to generate an orthonormal matrix 
V q that spans the same subspace as the Krylov subspace K q ( x ¥^). As a 
result, the guaranteed stable IIR filter can be constructed by substituting -V 
5 into Eq. (3). 

The Arnoldi method arises from the Hessenberg reduction A = VHV T 
for eigenvalue calculations. It has the advantage that it can be terminated 
part-way and leaving one with a partial reduction to a Hessenberg form. The 
process is exploited to form iterative algorithms. During the iteration process, 
10 an upper Hessenberg matrix H q <EC qxq is generated that satisfies the 
following relationship: 

= V q H q + h q+Xq v q+1 e T q and v, = £ /||£|| , (6) 
where e q is the qth unit vector in R q . The vector v q+1 satisfies a 
(<?+l)-term recurrence relation, involving itself and the preceding Krylov 

15 vectors. A new orthonormal vector v^ +1 can be generated using the modified 
Gram-Schmidt orthogonalization technique. 
The rational Arnoldi method 

Generally speaking, the accuracy of the Pade approximation based 
methods is lost away from the expansion point more rapidly as the 

20 eigenvalues of the FIR filter approach the expansion frequency. A rational 
Arnoldi (RA) method, which uses multiple expansion points, was developed 
to overcome this difficulty. The straightforward way for multi-point moment 
matching applications is to apply the Krylov subspace algorithm at various 



expansion frequencies. This is the so-called rational Krylov algorithm. 
Basically, this algorithm is a generalization of the shifted-and-inverted 
Arnoldi algorithm. To simplify the developments, the number of the matched 
moments of the lower-order IIR filter at each expansion point is assumed to 
be fixed. Formally, let Z = {z l ,z 2 , -~,z? } represent the set of predetermined 
expansion frequencies. Let J = {j\,] 2 be the set of the number of the 
matched moments at each corresponding frequency. The rational Arnoldi 
method will generate a lower-order IIR filter H(z) , which matches g-order 
(qr = ^. =1 ; / ) moments of the FIR filter, H(z), at the expansion points z /5 
i lj 2 j * * * , i . 

Implementing the rational Amoldi method is equivalent to implement 
the Amoldi method ] i times at i expansion frequencies. That is, the first 

]\ iterations correspond to the expansion frequency z 1 and the next ] 2 
iterations are associated with z 2 , and so on. Each Amoldi iteration generates 

7/ orthonormal vectors. Then, V q =[v x v 2 v q \ is the desired 
orthonormal matrix generated from a union Krylov space at various 
expansion points, as stated by 

Once the orthonormal matrix V q has been formed by applying the 
rational Arnoldi method and the lower-order IIR filter can be obtained using 
the congruence transformation. 
The rational Amoldi method with adaptive orders 

Selecting a set of expansion points z t for ;=l,2,--J and the number 



of matched moments j z about each z z is by no means trivial. For 

simplicity, the expansion points z t for i=l,2,- -,f are determined in 

advance using engineering heuristics or experimental measurements over a 

specified frequency range. This invention describes an intelligent scheme for 

5 choosing multiple expansion points in each of the iterations. 

Suppose that // 0) (z z ) = H (j \ Zi ) for ; = 0,1,- h -1 and f-1,2, — ,i 

after iterations of the rational Arnoldi algorithm. However, the ] t th-order 

output moments H^iz^^H^izi) can not be guaranteed. The concept 

that underlies the rational Arnodli method with adaptive orders is to select an 
10 expansion point z.. in the (#+l)st iteration. Hence, the resulting 

l q+l 

(#+l)st-order IIR filter yields the greatest moment improvement 
\H^(zi)-H^(zt)\ of the ^th-order IIR filter as z t = z, . The moment 

errors can be directly obtained in the new iteration without explicitly 

calculating system moments. 
15 Figure 4 displays the detail flow of the rational Arnoldi method with 

adaptive orders in step 4 in Fig. 2. 

Step 1, in Fig. 4, initializes the first vector fc^Cz,) = {zj n -A)~ y b of 

the Krylov sequence for each expansion point z £ , where ;e{l, - J}. Since 

the lower-order IIR filter and the orthonormal matrix are not yet determined, 
20 the residue r (0) (z, ) for each z, is set to ^(z,) . The normalization 

coefficient about each z/, h^fe), is initialized to be one. Step 2, in Fig. 4, 

begins the iterations and sets j =1. 

Step 3, in Fig. 4, chooses an expansion frequency z t such that z, 

10 



gives the greatest difference between the (/+l)st-order output moment of the 
original FIR filter H (z) and that of the lower-order IIR filter H (z) , that is, 

max Z/GZ |^ 0+1) (z £ )-^ 0+1) (z £ )hmax Z| . s \h x (z z )c V^Z;) \ . 
H U+i) ( z i) is the (/+l)st-order output moment of the lower-order IIR filter 
5 H{z), which is yielded using the congruence transformation matrix Ky_, 

0>1) and matches /-order output moments of H(z) at z t . The chosen 
expansion frequency in the yth iteration is called z* . 

After choosing the expansion point z.* in the determined jth iteration, 

ij 

the single-point Arnoldi method is applied at the expansion point z.* (unit 

10 52), which contains steps 4 and 5, as shown in Fig. 4. Step 4, in Fig. 4, 
generates the new orthnormal vector v } and the vector is incorporated into 
the orthnormal matrix . The normalization coefficient 

K ( z i ) = Ylj \ r (y ^ ( Zi % when z i ls selected in the yth iteration. 

Step 5, in Fig. 4, determines the new residual r 0) (z z ) at each 

15 expansion point z z . The calculation involves a projection with the new 
orthonormal matrix V Jm The next vector k u \z.* ) at the frequency z.. 

must be updated to enable further matching of the output moment in the 
(/+l)st iteration. Since no improvement is obtained at the other unselected 
frequency z /3 the vector /: 0) (z/) at frequency z i in the current iteration 
20 remains £ (; ~ i;) (z z ), which was obtained in the preceding iteration. Reset 
j = j +1 in step 6 and judge if j <q in step 7, as shown in Fig. 4. Finally, 
the resulting orthogonal projection matrix V q is generated in step 8 in Fig. 
4. 



li 



The resulting orthnormal matrix V q should be real to ensure that real 

system matrices of the lower-order IIR filter are generated if the complex 
expansion frequencies are used. First, all column vectors in V q are divided 
into the real part V r and the imaginary part V t . Second, a reduced QR 
5 factorization of [V r V{\ is performed to yield a new orthogonal matrix V q . 

The moment matching property of the resulting lower-order IIR filter by the 
new and real V q is also preserved. 

The details of the algorithm are outlined as follows. The vector Z 
includes i expansion points, q is the total number of iterations and V q is 
10 the resulting orthonormal matrix. 

Adaptive Rational Arnoldi (input: A, b, c,Z, q; output: V q ) 

(1) : /* Initialize */ 

1 for each z t GZ do 

2 kV\ Zi ):={ Zi I n -A)~ 1 b, r^( Zi ):=k^\ Zi ) 
15 3 A* (*/):-! 

4 end for 

(2) : /* Begin the Iterations */ 

5 for 7 =1,2, do 

(2.1) /* Select the Expansion Frequency with the Maximum 
20 Output Moment Error*/ 

6 Choose z, EZ as the i giving max, | h K ( Zi )c T r u ^\ Zi ) \ 

1 set z.. be the expansion frequency in they th iteration 

ij 

(2.2) /* Generate the Orthonormal Vector at z.. */, 

12 



8 hjj^z,):- r^\z,) 



10 
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9 v^r^Cz.O/Zz^Cz,) 

10 h 3t {z,):=h n {2,yh Lj .,(z r ) 

j l j l j 

(2.3) /* Update the Residue /- 0) (z t ) for the Next Iteration */ 

11 for each z t EZ do 

12 if { Zi — z . ) then tW(z,)> -fe/„ -^vy 

13 else k ^ (z t ):=k ( j ~ ly (z z - ) 

14 end if 

15 r^Czf):-* 0 '^^-) 

16 for r=l,2,---,; do 

17 Kjiz.y^r^iz,) 

18 ^ (y) (^):='" 0) fe)-^,yfe)v / 

19 end for 

20 end for 



21 end for 

22 =[ Vl v 2 v 9 ] 

Some properties of the method of approximating an FIR filter by 
low-order IIR filters in the invention are summarized as follows. 

(1) Exact expression of output moment errors: suppose that the output 
20 moments of the original FIR filter and those of the lower-order IIR filter are 
matched, that is, H^(z £ )^H Ui (zi) for j = 0,1,- - J\ -1 and i=X2, -J. 
The system matrices of the lower-order IIR filter are generated by the 
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congruence transformation with the orthonormal matrix V q using the 
algorithm, where q = ^'. =3 it • The magnitude error between the ] t th-order 
moments H^ ji \z t ) and // (7l) (z £ ) at each expansion point z i can be 
expressed as follows: 
5 |/f^>(z z 0-^ a) (z £ )H^c^^- l >(zO| 5 (10) 

where M*/) ^J^M " 

(2) Moment matching can still be preserved. 

(3) In the first iteration in the rational Arnodli algorithm with adaptive 
orders, step (2.2) is to choose z £ 6Z such that 

10 max(|c r (z / / /J -Ay l b\) = max(\H(z i )\) . This is equivalent to find out the 
expansion frequency with the maximum magnitude in the output frequency 
response. 

(4) Implementation issues of digital filters: the present invention also 
provides several heuristics of selecting expansion frequencies in advance for 

15 the proposed rational Arnoldi method. Generally speaking, the complex 
expansion points {z l5 z 2 , - ,z f } will be recommended, where each 

z-e^eC and 0^co L <jt . Then the frequency responses of the 
lower-order IIR filters at these points can be the same as those of the original 
FIR filter. Nevertheless, if real expansion points can be selected, the 
20 computational complexity of yielding approximate IIR filters can be further 
reduced. The following guidelines are provided: 

(a) Low-pass/high-pass filters: the proposed method with the 
expansion point a) x = 0 performs well over the low frequency range of 



responses. For high-pass filter designs, the special structures of state-space 
matrices may be used to present the duality between low-pass and high-pass 
filters. Let A =-A, b=b, c=c, and h Q =-h 0 , 

H(z)=c T (zI n -Ay x b +*^-2(-l) i+1 A i z" 1 • 

5 If H(z) presents a high-pass filter, then H(z) will be a low-pass 

filter, and a vice versa. Likewise, the expansion point cd x = 0 is chosen to 
perform the Arnoldi algorithm. If the corresponding orthonormal matrix V q 
is obtained, then the high-pass IIR filter, which satisfies the same 
specifications as the original FIR filter, can be constructed as follows: 

10 A = V q T AV q , b = V/b, and c=V q T c. 

(b) Band-pass/band-stop filters: experimental results indicate that the 
passband edge and stopband edge frequencies are appropriate candidate 
expansion points in meeting the specifications of the design. Other expansion 
points with uniform spacing are also recommend to be selected. 

15 Design Examples 

Three example filters are used to justify the proposed approach. Table 
1 describes specifications of a low-pass filter, a high-pass filter, and a 
band-pass filter. The command remez in Matlab was used to design the FIR 
filters by the optimal equiripple technique. Table 2 lists the corresponding 

20 orders. Then, the approximate low-order IIR filters were generated by the 
proposed method and the balanced realization method (BAL). Table 2 shows 
the reduced orders and the expansion points used by the two methods. 



Figures 5A-7C display the bode plots of the magnitude, the error in 
magnitude, and the phase of the original FIR filters and the low-order IIR 
filters. In figures 5A-7C, the responses of the original FIR filters are 
represented as thin solid lines. Those of the IIR filters, determined by the 
5 proposed method, are represented as thick solid lines and those determined 
by BAL method are plotted as thick dashed lines - The responses in the 
passband of the IIR filters are indistinguishable from those of the original 
FIR filters, independently of which the model reduction method is used. 
Simulation results imply that the performance of the proposed method is 
10 similar to that of the BAL method in the passband. The resulting lower-order 
IIR filters can actually preserve the linear-phase response of the original FIR 
filters. Nevertheless, in terms of computational efficiency, the Kylov 
subspace based methods generally outperform the BAL method. 



Table 1 Filter design specifications 



Specifications 


Low-Pass 


High-Pass 


Band-Pass 


Maximum passband attenuation 
(dB) 


3 


1 


1 


Maximum stopband attenuation 
(dB) 


40 


35 


35 


Lower passband edge (rad/s) 


0 


0.85* 


0.3255* 


Upper passband edge (rad/s) 


0.285*: 




0.3755 *r 


Lower stopband edge (rad/s) 


0.353*: 


0 


0.6655* 


Upper stopband edge (rad/s) 


1* 


0.78*: 


0.7155*: 
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Table 2 Matched orders and expansion points for IIR filter designs 





Low-Pass 


High-Pass 


Band-Pass 


FIR 


Order 


41 


41 


58 


IIR 


Order 


24 


17 


36 
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Expansion 
points 


co = 0 


co « {0.4jr,0.6^} 



Conclusions 

A rational Arnoldi method with adaptive orders for approximating FIR 
filters by low-order linear-phase IIR filters has been proposed. The 
5 developed method is very efficient in terms of computational complexity. 
Meanwhile, the lower-order IIR filter can truly reflect the dynamical features 
of the FIR filter and satisfies the original design specifications. 

Although the invention has been explained in relation to its preferred 
embodiment, it is to be understood that many other possible modifications 
10 and variations can be made without departing from the spirit and scope of the 
invention as hereinafter claimed. 
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